Maximum Entropy Sampling

Information " Chance and chance alone has a message for us. Everything that occurs out of necessity, everything expected, repeated day in and day out, is mute. Only chance can speak to us. We read its message much as gypsies read the images made by coffee grounds at the bottom of a cup. "-Milan Kundera (The Unbearable Lightness of Being) Entropy " I propose to name the magnitude S the entropy of the body from the Greek word ητ ρoπ`η, a transformation. I have intentionally formed the word entropy so as to be as similar as possible to the word energy, since both these quantities, which are to be known by these names, as so nearly related to each other in their physical significance that a certain similarity in their names seemed to me advantageous ... " — R. Clausius (1865)